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LAYERED MPEG ENCODER 

This application claims benefit of U.S. Provisional Patent Applications 
Serial Nos. 60/071,294 and 60/071,296, each filed January 16, 1998, and 
5 60/079,824 filed on March 30, 1998. This application is a continuation-in-part of 
Application Serial No. 09/050,304 filed March 30, 1998. 

The invention relates to communications systems generally and, more 
particularly, the invention relates to an MPEG-like information distribution 
system providing enhanced information quality and security. 

10 

BACKGROUND OF THE DISCLOSURE 
In several communications systems the data to be transmitted is 
compressed so that the available bandwidth is used more efficiently. For 
example, the Moving Pictures Experts Group (MPEG) has promulgated several 

15 standards relating to digital data delivery systems. The first, known as MPEG-1 
refers to ISO/IEC standards 11172 and is incorporated herein by reference. The 
second, known as MPEG-2, refers to ISO/IEC standards 13818 and is 
incorporated herein by reference. A compressed digital video system is described 
in the Advanced Television Systems Committee (ATSC) digital television 

20 standard document A/53, and is incorporated herein by reference. 

The above-referenced standards describe data processing and 
manipulation techniques that are well suited to the compression and delivery of 
video, audio and other information using fixed or variable length digital 
communications systems. In particular, the above-referenced standards, and 

25 other "MPEG-like" standards and techniques, compress, illustratively, video 
information using intra-frame coding techniques (such as run-length coding, 
Huffman coding and the like) and inter-frame coding techniques (such as 
forward and backward predictive coding, motion compensation and the like). 
Specifically, in the case of video processing systems, MPEG and MPEG-like video 

30 processing systems are characterized by prediction-based compression encoding 
of video frames with or without intra- and/or inter-frame motion compensation 
encoding. 
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In the context of digital video processing and digital image processing, 
information such as pixel intensity and pixel color depth of a digital image is 
encoded as a binary integer between 0 and 2 nl . For example, film makers and 
television studios typically utilize video information having 10-bit pixel intensity 
5 and pixel color depth, which produces luminance and chrominance values of 

between zero and 1023. While the 10-bit dynamic range of the video information 
may be preserved on film and in the studio, the above-referenced standards (and 
communication systems adapted to those standards) typically utilize a dynamic 
range of only 8-bits. Thus, the quality of a film, video or other information source 

10 provided to an ultimate information consumer is degraded by dynamic range 
constraints of the information encoding methodologies and communication 
networks used to provide such information to a consumer. 

Therefore, it is seen to be desirable to provide a method and apparatus to 
preserve the dynamic range of film, video and other forms of relatively high 

15 dynamic range information that are encoded and transported according to 

relatively low dynamic range techniques. Moreover, it is seen to be desirable to 
provide such dynamic range preservation while utilizing economies of scale 
inherent to these relatively low dynamic range techniques, such as the 
above-referenced MPEG-like standards and techniques. 

20 

SUMMARY OF THE INVENTION 
The invention provides a low cost method and concomitant apparatus for 
compressing, multiplexing and, in optional embodiments, encrypting, 
transporting, decrypting, decompressing and presenting high quality video 
25 information in a manner that substantially preserves the fidelity of the video 
information. In addition, standard quality circuits are used in a manner 
implementing, e.g., a high quality compression apparatus suitable for use in the 
invention. In optionally embodiments, pre-processing techniques are used to 
extend the apparent dynamic range of the standard compression, transport and 
30 decompression systems utilized by the invention. 

Specifically, an apparatus according to the invention is suitable for use in 
a system for distributing a video information signal comprising a plurality of full 
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dynamic range components and comprises: a compression encoder, for 
compression encoding the video information signal in a manner substantially 
retaining the full dynamic range of the full dynamic range components, the 
compression encoder comprising at least two standard encoders, each of the 
5 standard encoders being responsive to up to three component video signals, each 
of the standard compression encoders tending to substantially preserve a 
dynamic range and spatial resolution of only one component of the video signal, 
each of the standard compression encoders providing a compressed output video 
signal; and a multiplexer, for multiplexing the compressed output video signals 

10 of the two or more standard compression encoders to produce a multiplexed 
information stream. 

In another embodiment of the invention, each of three standard YUV-type 
MPEG encoders (e.g., 4:2:0 or 4:2:2) is used to encode a respective one of three 
component video signals utilizing only a luminance encoding portion of the 

15 encoder. A standard transport system delivers the three encoded component 
video signals to three standard YUV-type MPEG decoders (e.g., 4:2:0 or 4:2:2), 
which are each used to decode a respective encoded component video signal 
utilizing a luminance decoding portion of the decoder. 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

The teachings of the present invention can be readily understood by 
considering the following detailed description in conjunction with the 
accompanying drawings, in which: 

FIG. 1 depicts a high level block diagram of an audio-visual information 
25 delivery system according to the invention; 

FIG. 2 depicts a high level block diagram of a video compression unit and 
a video decompression unit according to the invention and suitable for use in the 
audio-visual information delivery system of FIG. 1; 

FIG. 3 depicts a high level block diagram of an alternate embodiment of a 
30 video compression unit and a video decompression unit according to the 

invention and suitable for use in the audio-visual information delivery system of 
FIG. 1; 
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FIG. 4 depicts a high level block diagram of an alternate embodiment of a 
video compression unit and a video decompression unit according to the 
invention and suitable for use in the audio-visual information delivery system of 
FIG. 1; 

5 FIG. 5A depicts a high level block diagram of an alternate embodiment of 

a video compression unit according to the invention and suitable for use in the 

audio-visual information delivery system of FIG. 1; 

FIGs. 5B and 5C depict a high level block diagram of an alternate 

embodiment of a video decompression unit according to the invention and 
10 suitable for use in the audio-visual information delivery system of FIG. 1; 
FIG. 6A depicts an enhanced bandwidth MPEG encoder; and 
FIG. 6B depicts an enhanced bandwidth MPEG decoder that is suitable 

for use in a system employing the enhanced bandwidth MPEG encoder of FIG. 

6A. 

15 To facilitate understanding, identical reference numerals have been used, 

where possible, to designate identical elements that are common to the figures, 

DETAILED DESCRIPTION 
After considering the following description, those skilled in the art will 
20 clearly realize that the teachings of the invention can be readily utilized in any 
information processing system in which high fidelity information is processed 
and transported using processing and transport techniques that typically cause a 
reduction in fidelity. An embodiment of the invention will be described within 
the context of a secure, high quality information distribution system suitable for 
25 distributing, e.g., motion pictures and other high quality audio-visual 

programming to, e.g., movie theaters. However, the scope and teachings of the 
invention have much broader applicability and, therefore, the invention should 
not be construed as being limited to the disclosed embodiments. 

FIG. 1 depicts a high level function diagram of a high fidelity information 
30 delivery system and method according to the invention. Specifically, FIG. 1 

depicts a high level block diagram of a high fidelity information delivery system 
and method suitable for compressing and securing a high fidelity information 

4 
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stream, illustratively an audio-visual information stream; transporting the 
secure, compressed audio-visual information to an information consumer 
utilizing standard techniques; and unlocking and decompressing the transported 
stream to retrieve substantially the original high fidelity audio-visual 
5 information stream. 

In the system and method of FIG. 1, a digital source 1 provides a digital 
information stream SI, illustratively a high fidelity audio-visual information 
stream, to a pre-transport processing function 2. The pre-transport processing 
function 2 comprises a compression function 21, an encryption and anti-theft 

10 function 22 and, optionally, a store for distribution function 23 to produce an 
information stream S23. A transport and delivery function 3 distributes the 
information stream S23 to a post-transport processing function 4. The 
post-transport processing function 4 comprises an optional store for display 
function 41, a decryption function 42 and a decompression function 43 to produce 

15 an output information stream S43. The output information stream S43 is 
coupled to a presentation device 5, illustratively a display device. 

The system and method of FIG. 1 will now be described within the context 
of a secure, high quality information distribution system suitable for 
distributing, e.g., motion pictures and other high quality audio-visual 

20 programming to, e.g., movie theaters. First, the appropriate fidelity and security 
parameters of the system will be discussed. Second, the realization of the 
fidelity and security parameters by the system will be discussed. Finally, 
specific implementations of system components will be discussed. 

As a practical matter, consumer enthusiasm for theater presentation of 

25 audiovisual programming, such as movies, is strongly related to the quality (in 
the fidelity sense, not necessarily the content sense) of the audio and video 
presentation. Thus, in a world of high definition television (HDTV) at home, the 
quality of the video and audio presented to consumers by a theater or cinema 
should be superior to the HDTV experienced in a well equipped home. Moreover, 

30 since theater owners and copyright holders benefit by restricting or controlling 
parameters related to the programming (e.g., ensuring secure delivery of the 
programming, limited venues, presentation times or number of presentations 
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and the like), the implementation of various distribution and security features is 
desirable. 

To provide adequate video fidelity, one embodiment of the system and 
method of FIG. 1 utilizes compression coding at the component level (i.e., RGB) 
5 rather than at the color difference level (i.e., YUV). This embodiment will be 
discussed in more detail below with respect to FIG. 2. Briefly, the embodiment of 
FIG. 2 provides compression coding that preserves 4:4:4 resolution video, rather 
than the 4:2:0 resolution video typically used in MPEG systems. 

The MPEG 8-bit 4:4:4 resolution produces results that are adequate for 

10 some applications of the invention. For those applications requiring a higher 
degree of fidelity, the invention preferentially utilizes an effective color depth 
that is greater than the 8-bit color depth typical of MPEG systems, such as a 
color depth of at least 10 bits log per primary color. To achieve enhanced color 
depth (i.e., greater than 8-bits) using standard 8-bit MPEG components 

15 (decoders, encoders and the like), additional pre-encoding and/or post-decoding 
processing may be utilized, as will now be explained. 

Another embodiment of the system and method of FIG. 1 utilizes regional 
pixel-depth compaction techniques for preserving the dynamic range of a 
relatively high dynamic range signal. A regional pixel depth compaction method 

20 and apparatus suitable for use in the method and system of FIG. 1 is described 
in more detail below with respect to the enhanced MPEG encoder of FIG. 6, and 
in co-pending U.S. Patent Application No. 09/050,304, filed on March 30, 1998, 
and Provisional U.S. Patent Application No. 60/071,294, filed on January 16, 
1998, both of which are incorporated herein by reference in their entireties. 

25 Briefly, the described method and apparatus segments a relatively high dynamic 
range signal into a plurality of segments (e.g., macroblocks within a video 
signal); determines the maximum and minimum values of a parameter of 
interest (e.g., a luminance, chrominance or motion vector parameter) within each 
segment, remaps each value of a parameter of interest to, e.g., a lower dynamic 

30 range defined by the maximum and minimum values of the parameter of 
interest; encodes the remapped segments in a standard (e.g., lower dynamic 
range) manner; multiplexes the encoded remapped information segments and 

6 
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associated maximum and minimum parameter values to form a transport stream 
for subsequent transport to a receiving unit, where the process is reversed to 
retrieve the original, relatively high dynamic range signal. A technique for 
enhancing color depth on a regional basis can be used as part of the digitizing 
5 step to produce better picture quality in the images and is disclosed in the above- 
referenced Provisional U.S. patent application. 

Another aspect of the system of FIG. 1 is the facilitation of a moderate 
level of random access into at least the unencrypted information stream (e.g., to 
insert advertisements, coming attraction trailers and the like), by including 

10 limited (e.g., every minute) random access points within the stream. Such 
random access points may be provided in a standard manner as described in, 
e.g., the MPEG specifications. 

Another aspect of the system 100 of FIG. 1 is the use of high quality 
encoding for all frame rates, including the standard film frame rates or 24Hz 

15 and 25 Hz. The system 100 utilizes a high bandwidth (e.g., 40 Mbits/sec) 

compression encoding and decoding scheme. Moreover, the system is capable of 
compressing, decompressing, and displaying any aspect ratio within the 
capabilities of the encoder and/or decoder employed by the invention, without 
needlessly compressing lines outside the original images. Moreover, it should be 

20 clearly understood that in the event a particular aspect ratio is not within the 
capabilities of an encoder and/or decoder, known 'letterbox" and other image 
cropping techniques may be used. The system is also capable of decompressing in 
real time a very high resolution (e.g., 2000 pixels by 1000 pixels) moving picture 
having a high display rate such as 48 or 72 Hz (or the European 50 and 75Hz). 

25 The bandwidth and resolution capabilities of the system are, of course, limited 
by the particular sub-system components used within the system, such as 
display device resolutions, transport systems and the like. 

The system optionally utilizes motion estimation algorithms to reduce 
redundancy between images. Suitable motion estimation techniques are 

30 described in U.S. patent applications serial no. 08/612,005, filed March 4, 1996; 
08/735,869, filed October 23, 1996; 60/048,181, filed May 30, 1997; 08/884,666, 
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filed June 27, 1997 and 08/735,871, filed October 23, 1996, all of which are 
incorporated herein by reference in their entirety. 

To ensure high fidelity audio, the system advantageously utilizes any 
standard audio format, such as 8-channel sound encoded with the image using 
5 48 KHz audio sampling. 

The digital source 1 comprises, illustratively, any source of high fidelity 
audio-visual information such as high-resolution digital video having a 
resolution suitable for use in, e.g., a movie theater. For example, moving images 
that originated on film may be scanned into electronic form using telecine or 

10 other known methods. Similarly, moving images may be initially captured with 
a camera having a sufficiently high resolution and color depth (i.e., resolution 
and color depth approximating film), or scanned electronically from an existing 
video source or file. 

The pre-transport processing function 2 of the system 100 of FIG. 1 

15 receives and processed the digital information stream SI to produce a pre- 
transport information stream S22. The pre-transport information stream S22 
may be coupled directly to the transport and deliver function 3 for transport 
packaging and delivery. Optionally, the pre-transport information stream S22 
may be coupled to a store for distribution unit, illustratively a hard disk array, 

20 for storage prior to subsequent distribution via the transport and deliver 
function 3. The pre-transport information stream S22 may comprise, e.g., a 
packetized elementary stream, a transport stream or an asynchronous transfer 
mode (ATM) stream. The pre-transport information stream S22 may also 
comprise a TCP/IP stream. 

25 The compression unit 21 compression encodes the high dynamic range 

information stream SI, illustratively a video stream, at a "film image" quality 
(i.e., preserve the dynamic range of the film) to produce a compressed 
information stream S21. Several embodiments of compression unit 21 will be 
described below with respect to FIGS. 2 and 3. When the compressed 

30 information stream S21 is subsequently decompressed by the decompression unit 
43, substantially the entire bandwidth of the initial video or other high dynamic 
range information source will be retrieved. It must be noted that compression 

8 
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technologies such as MPEG were designed particularly for video compression 
and use color spaces, e.g., YUV, specifically used in the video realm, as opposed 
to the film realm. In particular, various constraints that apply to video do not 
apply to film or electronic film equivalents, and, therefore, these current 
5 standard video compression formats are not necessarily appropriate for the 
compression of digital images associated with film. 

The encryption and anti-theft unit 22 encrypts the compressed 
information stream S21 to produce an encrypted information stream S22. The 
encryption and anti-theft unit 22 is specifically designed to thwart piracy of high 

10 dynamic range information streams, such motion picture information streams. 
The encryption and anti -theft unit 22 addresses piracy in two ways, 
watermarking and encryption. 

Watermarking methods and apparatus suitable for use in the encryption 
and anti-theft unit 22 are disclosed in U.S. Patent Application No. 09/001,205, 

15 filed on December 30, 1997, and U.S. Patent Application No. 08/997,965, filed on 
December 24, 1997, both of which are incorporated herein by reference in their 
entireties. The disclosed watermarking methods and apparatus are used to 
modify the compressed information streams to allow identification of, e.g., the 
source of the stream. In this manner, a stolen copy of a motion picture may 

20 examined to determine, e.g., which distribution channel (or which distributor) 
lost control of the motion picture. 

Standard encryption methods and apparatus may be used in the 
encryption and anti-theft unit 22. Such methods include, e.g., dual key 
encryption and other methods that are directed toward preventing utilization of 

25 the underlying, protected data. In this manner, even in the event of theft, a 

motion picture cannot be displayed without the original owners' permission (i.e., 
the decryption key). Thus, motion pictures may be securely transmitted by 
electronic means, obviating the present practice of physically transported motion 
pictures in bulky packages that are secured only by purely physical means. 

30 The optional store for distribution unit 23 is provides temporary storage of 

the compressed and encrypted moving pictures prior to transmission/transport of 
the compressed and encrypted moving pictures to an end user, such as a movie 

9 



WO 99/37097 



PCT/US99/00352 



theater. The optional store for distribution unit 23 may be implemented using 
any media suitable for computer material, such as hard disks, computer 
memory, digital tape and the like. An apparatus for partial response encoding on 
magnetic media may be used to increase the amount of storage on computer 
5 disks and tapes, and hence lower the cost of the media necessary for storage of 
digitized moving pictures. Such an apparatus is described in U.S. Patent 
Application No. 08/565,608, filed on November 29, 1995, and incorporated herein 
by reference in its entirety. 

The transport and delivery function 3 distributes the information stream 

10 S23 to a post-transport processing function 4. Because of the digital nature of 
the moving pictures that are encoded and encrypted by the system, transport 
and delivery function 3 may be implemented in a manner that cannot be used for 
moving pictures on film. For example, the transport and delivery function 3 
may be implemented using a digital storage medium for physically transporting 

15 the data to, e.g., a theater. In this case, the physical medium is less bulky than 
film while providing the security of encryption and watermarking. The 
transport and delivery function 3 may also be implemented using an electronic 
communications medium (e.g., public or private communications network, 
satellite link , telecom network and the like), for electronically transporting the 

20 data from the point of distribution to the theater. In this case there is no 
physical storage transported between sites. 

The transport and delivery function 3 may be implemented using a 
communications system comprising one or more of, a satellite link, a public or 
private telecommunications network, a microwave link or a fiber optic link. 

25 Other types of communications links suitable for implementing the transport 
and delivery function 3 are known to those skilled in the art. 

The post-transport processing function 4, which comprises the optional 
store for display function 41, decryption and anti-theft function 42 and 
decompression function 43, produces an output information stream S43 that is 

30 coupled to a presentation device 5, illustratively a display device. 

The optional store for display function 41 is used for, e.g., in-theater 
storage of a transported motion picture representative information stream. Due 
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to the digital nature of the transported information stream, the storage is much 
more secure, much less bulky, and much more robust than film. All the films 
showing at a theater may be stored in single place and displayed at any time 
through any projector (e.g., presentation device 5) in the theater simply by 
5 running the necessary cables. The same server technology used for the optional 
store for distribution function 23 may be used for the store for display function 
41. When used, the optional store for display function 41 couples stored 
information streams to the decryption and anti-theft unit 42 as stream S4L 
Standard decryption methods and apparatus may be used in the 

10 decryption and anti-theft unit 42, as long as they are compatible with the 

encryption methods and apparatus used in the encryption and anti-theft unit 22. 
That is, the encrypted and compressed moving pictures must be decrypted and 
decompressed at the theater in order for them to be displayed to an audience. 
The decryption and anti-theft unit 42 produces a decrypted information stream 

15 S42 that is coupled to the decompression function 43. 

A preferred decryption method utilizes certificates and trusted authorities 
to ensure that the digital form of the moving picture will be unintelligible to any 
person or device that attempts to use it without the proper authority. No 
unauthorized user is able to decrypt the bits of the moving picture without the 

20 appropriate key or keys, and these will be available only to appropriately 

authorized theaters. Thus, stealing the digital form of the moving picture itself 
will be of no use to a thief, because it will be impossible to display without the 
appropriate decryption keys. As previously discussed, an additional layer of 
security is provided by the use of watermarks in the digital bitstream, so that in 

25 the event of piracy, a stolen copy and its source may be readily identified. 
Because the watermarks are put into the compressed bitstream, it will be 
possible to put different watermarks into each bitstream, so that each copy that 
is sent out can be uniquely identified. 

The decompression function 43 decompresses the motion picture (or other 

30 information stream) in real time and couples a decompressed information stream 
S43 to the presentation unit 5. The decompression function 43 and presentation 
function 5 may be integrated to form a self-contained, combined decompression 

11 
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function 43 and presentation function 5. In this manner, there is no opportunity 
to record or capture the decompressed images on any medium, since the self- 
contained, combined decompression function 43 and presentation function 5 has 
no output other than the images themselves. This is very important for the 
5 protection of the material in the digitized movie so that illegal electronic copies 
of the original cannot be made and displayed. 

The presentation unit 5 may comprise a projector that takes RGB inputs 
of the dynamic range output by the system and displays those colors faithfully 
and, as closely as possible, with the full contrast and brightness range of the 

10 original image. 

FIG. 1 also depicts additional decryption and anti-theft units 42-1 through 
42-n, additional decompression functions 43-1 through 43-n and additional 
presentation units 5-1 through 5-n. As shown in FIG. 1, each of the additional 
decryption and anti-theft units 42-1 through 42-n are coupled to receive the 

15 same signal S41 from optional store for display unit 41. Such an arrangement is 
suitable for use in, illustratively, a multiple screen (i.e., display device 5) theater 
simultaneously presenting a first run movie on multiple screens. In normal 
operation, since a different movie is presented on each additional screen, each 
screen is supported by a respective decryption function and decompression 

20 function. Thus, store for display unit 41 may be used to provide a separate 

output signal (not shown) for each additional decryption and anti-theft unit 42-1 
through 42-n. 

FIGs. 2-4 depict respective high level block diagrams of a video 
compression unit 21 and a video decompression unit 43 according to the 

25 invention and suitable for use in the audio-visual information delivery system of 
FIG. 1. It must be noted that each embodiment advantageously leverages 
existing technology to encode and decode electronic cinema quality video 
information. For example, existing MPEG encoders typically utilize YUV space, 
decimating the U and V channels and encoding the decimated U and V channel 

30 information at a much lower bandwidth than the Y channel information (e.g., 
the known 4:2:0 video format). Similarly, existing MPEG decoders typically 
decode the 4:2:0 format encoded video to produce full bandwidth Y channel and 
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decimated U and V channel video. Thus, utilizing the below embodiments of the 
invention, high dynamic range information, such as electronic cinema 
information, may be economically encoded, transported in a normal manner, and 
decoded without losing any dynamic range. It must be noted that several 
5 encoders and/or decoders may, of course, be used to form a single integrated 
circuit utilizing known semiconductor manufacturing techniques. 

FIG. 2 depicts a high level block diagram of a video compression unit 21 
and a video decompression unit 43 according to the invention and suitable for 
use in the audio- visual information delivery system of FIG. 1. Specifically, the 

10 video compression unit 21 depicted in FIG. 2 comprises three standard MPEG 
encoders 218R, 218G and 218B and a multiplexer 219. Similarly, the video 
decompression unit 43 depicted in FIG. 2 comprises a demultiplexer 431 and 
three standard MPEG decoders 432R, 432G and 432B. 

Referring now to the video compression unit 21, a full depth (i.e., full 

15 dynamic range) red SIR input video signal is coupled to a luminance input of the 
first standard MPEG encoder 218R; a full depth green S1G input video signal is 
coupled to a luminance input of the second standard MPEG encoder 218B; and a 
full depth green S1G input video signal is coupled to an input of the third 
standard MPEG encoder 218G. 

20 Each of the standard MPEG encoders 218R, 218G and 218B produces a 

respective full depth compressed output signal S218R, S218G and S218B that is 
coupled to the multiplexer 219. The multiplexer 219 multiplexes the encoded, 
full depth compressed video output signals S218R, S218G and S218B to form the 
compressed bitstream S21. 

25 It must be noted that the standard MPEG encoders 218R, 218G and 218B 

are typically used to encode YUV space video having a 4:2:0 resolution. That is, 
the encoders are typically used to provide full resolution encoding of the 
luminance channel and reduced resolution encoding of the chrominance 
channels. Thus, by utilizing only the luminance portion of MPEG encoders 

30 218R, 218G and 218B, the video compression unit 21 of FIG. 2 provides full 
depth encoding (in RGB space) of the luminance and chrominance information. 
It should also be noted that there exists MPEG decoders providing RGB output 
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signals in response to encoded input streams do exist. However, such decoders 
typically cost more and provide insufficient resolution. 

Referring now to the video decompression unit 43 , the demultiplexer 431 
receives a compressed bitstream S42 corresponding to the compressed bitstream 
5 S21. The demultiplexer extracts from the compressed bitstream S42 three full 
depth compressed video streams S431R, S431G and S431G corresponding to the 
full depth compressed video streams S218R, S218G and S218B. The full depth 
compressed video streams S431R, S431G and S431G are coupled to a luminance 
input of, respectively, standard MPEG decoders 432R, 432G and 432B. The 

10 standard MPEG decoders 432R, 432G and 432B responsively produce, 

respectively, a full depth red S43R video signal, a full depth blue S43B video 
signal and a full depth green S43G video signal. 

It must be noted that the standard MPEG decoders 432R, 432G and 432B 
are typically used to decode YUV space video having a 4:2:0 resolution. Thus, by 

15 utilizing only the luminance portion of MPEG encoders 432R, 432G and 432B, 
the video decompression unit 43 of FIG. 2 provides full depth decoding (in RGB 
space) of the luminance and chrominance information initially provided to the 
video compression unit 21. In this manner, the embodiments of the video 
compression unit 21 and video decompression unit 43 depicted in FIG. 2 provide 

20 economical implementation of an electronic cinema quality encoding, transport 
and decoding functions. 

FIG. 3 depicts a high level block diagram of an alternate embodiment of a 
video compression unit 21 and a video decompression unit 43 according to the 
invention and suitable for use in the audio-visual information delivery system of 

25 FIG. 1. Specifically, the video compression unit 21 depicted in FIG. 3 comprises 
a format converter 211, a pair of low pass/high pass filter complements 
(LPF/HPFs) 212 and 213, a motion estimation unit 214, an MPEG-2 compression 
unit 215, an enhancement layer data compression unit 217 and a multiplexer 
216. Similarly, the video decompression unit 43 depicted in FIG. 3 comprises a 

30 demultiplexer 433, an MPEG decoder 310, and enhancement layer decoder 320, 
a first adder 330, a second adder 340 and a format converter 350. 
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The format converter 211 converts an input RGB video signal SIR, SIB 
and S1G into a full depth luminance signal Y, a first full depth color difference 
signal LP and a second full depth color difference signal V\ The first and second 
full depth color difference signals, U' and V, are coupled to, respectively, first 
5 and second low pass/high pass filter complements 212 and 213. 

Each of the low pass/high pass filter complements 212 and 213 comprises, 
illustratively, a low pass digital filter and a complementary high pass digital 
filter. That is, the high frequency 3dB roll-off frequency of the low pass digital 
filter is approximately the same as the low frequency 3dB roll-off frequency of 

10 the high pass digital filter. The roll-off frequency is selected to be a frequency 
which passes, via the low pass digital filter, those frequency components 
normally associated with a standard definition chrominance signal. The roll-off 
frequency also passes, via the high pass digital filter, those additional frequency 
components normally associated with only a high definition chrominance signal. 

15 The first low pass/high pass filter complement 212 and second low 

pass/high pass filter complement 213 produce, respectively, a first low pass 
filtered and decimated color difference signal U L and a second low pass filtered 
and decimated color difference signal V L . The luminance signal Y, first low pass 
filtered color difference signal U L and second low pass filtered color difference 

20 signal V L are coupled to the motion estimation unit 214. 

Those skilled in the art will known that certain phase compensation, delay 
and buffering techniques should be employed to compensate for, e.g., group delay 
and other filtering artifacts to ensure that the luminance signal Y, first low pass 
filtered color difference signal U L and second low pass filtered color difference 

25 signal V L are properly synchronized. 

The full depth luminance Y, first color difference U' and second color 
difference V signal form a video signal having a 4:4:4 resolution. By contrast, 
the luminance Y, first low pass filtered color difference U L and second low pass 
filtered color difference V, signals form a video signal having, illustratively, a 

30 standard MPEG 4:2:2 or 4:2:0 resolution. Thus, motion estimation unit 214 and 
MPEG2 compression unit 215 may be implemented in a known manner using, 
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e.g., inexpensive (i.e., "off the shelf) components or cells for use in application 
specific integrated circuits (ASICs). 

Motion estimation unit 214 and MPEG2 compression unit 215 produce at 
an output a compressed video stream S215 that is coupled to multiplexer 216. In 
5 addition, motion estimation unit 214 produces a motion vector data signal MV 
DATA indicative of the motion vectors for, e.g., each macroblock of the YUV 
video stream being estimated. 

The first low pass/high pass filter complement 212 and second low 
pass/high pass filter complement 213 produce, respectively, a first high pass 

10 filtered color difference signal U H and a second high pass filtered color difference 
signal V H . The first high pass filtered color difference signal U H and a second 
high pass filtered color difference signal V H are coupled to the enhancement layer 
data compression unit 217. 

Enhancement layer data compression unit 217 receives the first high pass 

15 filtered color difference signal U H , the second high pass filtered color difference 
signal V H and the motion vector data signal MV DATA. In response, the 
enhancement layer data compression unit 217 produces at an output an 
information stream S217 comprising an enhancement layer to the compressed 
video stream S215. The enhancement layer information stream S217 comprises 

20 high frequency chrominance information (i.e., U H and V H ) that corresponds to the 
standard frequency chrominance information (i.e., U L and V r ) within the 
compressed video stream S215. The motion vector information within the 
enhancement layer information stream S217, which is generated with respect to 
the standard frequency chrominance information (i.e., U L and V L ), is used to 

25 ensure that the spatial offsets imparted to the standard frequency components 
are also imparted to the corresponding high frequency components. The 
enhancement layer information stream S217 is coupled to multiplexer 216. 

Multiplexer 216 multiplexes the compressed video stream S215 and the 
enhancement layer information stream S217 to form the compressed bitstream 

30 S21. In the embodiment of FIG. 3, the compressed video stream S215 comprises 
a standard MPEG2 stream. The enhancement layer information stream S217 is 
also compressed, using compression parameters from the MPEG compression, 
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such as the illustrated motion vectors and, optionally, other standard MPEG 
compression parameters (not shown). 

Referring now to the video decompression unit 43, the demultiplexer 433 
receives a compressed bitstream S42 corresponding to the compressed bitstream 
5 S21. The demultiplexer 433 extracts, from the compressed bitstream S42, the 
compressed video stream S215 and the enhancement layer information stream 
S217. The compressed video stream S215 is coupled to MPEG decoder 310, 
while the enhancement layer of information of stream S217 is coupled to the 
enhancement layer decoder 320. 

10 MPEG decoder 310 operates in a standard manner to decode compressed 

video stream S215 to produce a luminance signal Y, a first standard resolution 
color difference signal U L and a second standard resolution color difference signal 
V L . The first standard resolution color difference signal U L is coupled to a first 
input of first adder 330, while the second standard resolution color difference 

15 signal V L is coupled to a first input of second adder 340. The luminance signal Y 
is coupled to a luminance input of format converter 350. 

Enhancement layer decoder 320 decodes the enhancement layer 
information stream S217 to extract the high frequency components of the first 
color difference signal U H and the second color difference signal V H . The high 

20 frequency components of the first color difference signal U H are coupled to a 
second input of first adder 330, while the high frequency components of second 
color difference signal V H are coupled to a second input of second adder 340. 

First adder 330 operates in a known manner to add the first standard 
resolution color difference signal U L and the high frequency components of the 

25 first color difference signal U H to produce full depth first color difference signal 
LP. Second adder 340 operates in a known manner to add the second standard 
resolution color difference signal V L and the high frequency components of the 
second color difference signal V H to produce full depth second color difference 
signal U\ The first full depth color difference signal LP and second full depth 

30 color difference signal V are coupled to the format converter 350. Format 
converter 350 operates in a standard manner to convert the 4:4:4 YLJV space 
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video signal represented by the Y, LP and V components into corresponding RGB 

space signals S43R, S43G and S43B. 

The embodiments of the video compression unit 21 and video 

decompression unit 43 depicted in FIG. 3 advantageously leverage existing 
5 MPEG encoder and decoder technology to provide an electronic cinema quality 

video information stream comprising a standard resolution video stream S215 

and an associated enhancement layer video stream S217. It must be noted that 

in the absence of the enhancement layer video stream S217, the enhancement 

layer decoder 320 will produce a null output. Thus, in this case, the output of 
10 first adder 330 will comprise only the first standard resolution color difference 

signal U L , while the output of second adder 340 will comprise only the second 

standard resolution color difference signal V L . 

In one embodiment of the invention, the enhancement layer decoder 320 is 

responsive to a control signal CONTROL produced by, illustratively, an external 
15 control source (i.e., user control) or the decryption unit 42 (i.e., source or access 

control). 

FIG. 4 depicts a high level block diagram of an alternate embodiment of a 
video compression unit and a video decompression unit according to the 
invention and suitable for use in the audio-visual information delivery system of 

20 FIG. 1. Specifically, the video compression unit 21 depicted in FIG. 4 comprises 
a format converter 211, a pair of low pass filters (LPFs) 402 and 404, an three 
MPEG encoders 410-412, an MPEG decoder 420, a pair of subtractors 406 and 
408, and a multiplexer 440. Similarly, the video decompression unit 43 depicted 
in FIG. 4 comprises a demultiplexer 450, second, third and fourth MPEG 

25 decoders 421-423, first and second adders 466 and 468, and a format converter 
470. 

The format converter 211 converts and input RBG video signal SIR, SIB 
and S1G into a full depth luminance signal Y, a first full depth color difference 
signal LP and a second full depth color difference signal V. The first and second 
30 full depth color signals, LP and V, are coupled to, respectively, first low pass 
filter 402 and second low pass filter 404. The first and second full depth color 
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signals, U' and V, are also coupled to a first input of first subtractor 406, and a 
first input of second subtractor 408. 

The first low pass filter 402 and second low pass filter 404 produce, 
respectively, a first low pass filtered and decimated color difference signal U and 
5 a second low pass filtered and decimated color difference signal V. The 

luminance signal Y, first low pass filtered and decimated color difference signal 
U and second low pass filtered and decimated color difference signal V are 
coupled to first MPEG encoder 410. First MPEG encoder 410 operates in the 
standard manner to produce, illustratively, a 4:2:0 compressed output stream 

10 Cyuv- The MPEG encoded output stream is coupled to multiplexer 440 and 
MPEG decoder 420. 

MPEG decoder 420 decodes the encoded output stream produced by 
MPEG encoder 410 to produce a first decoded color difference signal U D , and a 
second decoded color difference signal V ir The first decoded color difference 

15 signal U D and the second decoded color difference signal V D are coupled to, 

respectively, a second input of first subtractor 406 and a second input of second 
subtractor 408. 

First subtractor 408 subtracts the first decoded color difference signal U D 
from the first full depth color difference signal U' to produce a first color sub 

20 differencing signal ?U. The second subtractor 408 subtracts the second decoded 
color difference signal V D from the second full depth color signal V to produce a 
second color sub-difference signal ?V. 

The first color sub-difference signal ?U is coupled to a luminance input of 
second MPEG decoder 411. The second color sub-difference signal ?V is coupled 

25 to a luminance input of third MPEG encoded 412. The second MPEG encoder 
411 operates in a standard manner to compression code the first color sub- 
difference signal ?U to produce a first encoded color sub-difference signal C ?u . 
The third MPEG encoder 412 operates in a standard manner to compression 
code the second color sub-difference signal ?V to produce a second coded color 

30 difference sub-signal C ?v . The first and second compression coded color sub- 
difference signals C ?u and C ?v are coupled to multiplexer 440. 
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Multiplexer 440 multiplexes the compression coded output streams from 
first MPEG encoder 410 (C^), second MPEG encoder 411 (C^) and third MPEG 
encoder 412 (C, v ) to form the compressed bit stream S21. 

Referring now to the video decompression unit 43, the demultiplexer 450 
5 receives a compressed bit stream S42 corresponding to the compressed bit 
stream S21 produced at the output of multiplexer 440. The demultiplexer 450 
extracts from the compressed bitstream S42 three compressed video streams 
corresponding to the outputs of first MPEG encoder 410 (C^), second MPEG 
encoder 411 (C^) and third MPEG encoder 412 (C, v ). Specifically, demultiplexer 

10 450 extracts, and couples to an input of MPEG decoder 421, the compressed YUV 
stream produced by MPEG encoder 410. Demultiplexer 450 also extracts, 
and couples to an input of the third MPEG decoder 422, the compressed first 
color sub-difference stream C^. Demultiplexer 450 also extracts, and couples to 
an input of the fourth MPEG decoder 423, the compressed second color sub- 

15 difference stream C ?v . 

Second MPEG decoder 421 decodes the compressed YUV stream in a 
standard manner using, illustratively, 4:2:0 decompression to produce a 
luminance signal Y, a first low pass filtered and decimated color difference signal 
U and a second low pass filtered and decimated color difference signal V. 

20 Luminance signal Y is coupled directly to format converter 470. First low pass 
filtered and decimated color difference signal U is coupled to a first input of first 
adder 466. Second low pass filtered and decimated color difference signal V is 
coupled to a first input of second adder 468. 

Third MPEG decoder 422 operates in a standard manner to decode the 

25 first encoded color sub-difference signal C ?u , to produce at a luminance output a 
first color sub-difference signal ?U. Fourth MPEG decoder 423 operates in a 
standard manner to decode second encoded color sub-difference C ?v produced at a 
luminance output a second color sub-difference signal TV. First and second color 
sub-difference signal ?U and TV are coupled to, respectively, a second input of 

30 first adder 466, and a second input of second adder 468. 

First adder 466 operates in a standard manner to add first low pass 
filtered and decimated color difference signal U and first color sub-difference 
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signal ?U to produce at an output a first full depth color difference signal LP, 
which is then coupled to format converter 470. Second adder 468 operates in a 
standard manner to add second low pass filtered and decimated color difference 
signal V to second color sub-difference signal ?V to produce at an output a second 
5 full depth color difference signal V, which is coupled to format converter 470. 

Format converter 470 operates in a standard manner to covert full depth 
luminance signal Y, full depth first color difference signal LP and second full 
depth color difference signal V to red R, green G and blue B RGB space output 
signals. 

10 In the embodiment of FIG. 4, the MPEG encoders 410 through 412, and 

the MPEG decoders 420 through 423 are standard (i.e., inexpensive) MPEG 
encoders and decoders that are typically used to operate upon video information 
signals according to the well known 4:2:0 resolution format. The video 
compression unit 21 of FIG. 4 operates to produce 3 compressed signals, C^, C ?u , 

15 and C ?v . The two compressed color sub-difference signals, C ?u and C ?v , are 

representative of the difference between the full depth color difference signals IP 
and V and the low pass filtered and decimated color difference signals U and V 
incorporated with the compressed output stream C YUV of the MPEG encoder 410. 
MPEG decoder 420 is used to retrieve the actual color difference signals 

20 U D and V n incorporated within the compressed output stream of output encoder 
410. The derived color difference signals are then subtracted from the full depth 
color difference signals to produce their respective color sub-difference signals. 
The color sub-difference signals are then encoded by respective MPEG encoders 
and multiplexed by multiplexer 440. 

25 The video decompression unit operates to decode the C^, G, u? and C v 

signals to produce respectively YUV, ?U, and ?V signals. The color sub- 
difference signal ?U is added back to the decoded color difference signal U to 
produce the full depth color difference signal LI. Similarly, the color sub- 
difference signal TV is added back to the color difference signal V to produce a 

30 full depth color difference signal V. In this manner standard MPEG encoders 
and decoders are used to inexpensively implement a system capable of producing 
4:4:4 luma/chroma video information signals. 

21 
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FIG. 5 A depicts a high level block diagram of an alternate embodiment of 
a video compression unit 21 according to the invention and suitable for use in 
the audio-visual information delivery system of FIG. 1. FIGs. 5B and 5C depict 
respective high level block diagrams of an alternate embodiment of a video 
5 decompression unit 43 according to the invention and suitable for use in an 
audio-visual information delivery system employing the video compression unit 
21 of FIG. 5A. 

The alternate embodiments video compression unit 21 and video 
decompression unit 43 depicted in FIGs. 5A-5C are based on the inventor's 

10 recognition that YIQ video representations of video require less bandwidth than 
YUV representations of the same video. Specifically, the color components of a 
YUV representation (i.e., the U and V color difference signals) require the same 
amount of bandwidth within standard MPEG systems. Historically, the YUV 
representations are based on the European PAL analog television scheme. By 

15 contrast, the United States NTSC analog television scheme utilizes a YIQ 

representation of video. The YIQ representation utilizes a lower bandwidth for 
the Q component than for the I component. This is possible because the Q color 
vector represents a "purplish" portion of the chrominance spectrum, and a slight 
degradation in accuracy in this portion of the spectrum is not readily apparent to 

20 the human eye. Thus, the total bandwidth requirement of a YIQ representation 
of a video signal is less than the total bandwidth requirement for a YUV video 
signal, while providing comparable picture quality. 

Referring now to FIG. 5 A. The video compression unit 21 depicted in FIG. 
5A comprises a format converter 502, a pair of 'low horizontal, low vertical" (LL) 

25 spatial filters 504 and 506, a 'low horizontal, high vertical" (LH) spatial filter 
508, a "high horizontal, low vertical" (HL) spatial filter 510, a pair of spatial 
frequency translators (i.e., downconverters) 509 and 511, a pair of MPEG 
encoders 520 and 522 and a multiplexer 440. 

The format converter 502 converts an input RGB video signal SIR, S1G 

30 and SIB into a full depth luminance signal Y, a full depth in-phase chrominance 
signal I' and a full depth quadrature-phase chrominance signal Q\ The full 
depth luminance signal Y is coupled to a luminance input Y of first MPEG 
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encoder 520. The full depth in-phase chrominance signal I' and full depth 
quadrature-phase chrominance signal Q' are coupled to, respectively, first LL 
spatial filter 504 and second LL spatial filter 506. The full depth quadrature- 
phase chrominance signal Q' is also coupled to LH spatial filter 508 and HL 
5 spatial filter 510. The full depth in-phase chrominance signal I' is also coupled to 
a luminance input Y of the second MPEG decoder 522. 

The LL spatial filter 504 operates in a known manner to horizontally low 
pass filter and vertically low pass filter the full depth in-phase chrominance 
signal I' to produce an LL spatial filtered and subsampled in-phase chrominance 

10 signal I LL , which is then coupled to a first chrominance input of MPEG encoder 
520. The LL spatial filter 506 operates in a known manner to horizontally low 
pass filter and vertically low pass filter the full depth quadrature-phase 
chrominance signal Q' to produce an LL spatial filtered and subsampled 
quadrature-phase chrominance signal Q LL , which is then coupled to a second 

15 chrominance input of MPEG encoder 520. 

First MPEG encoder 520 operates in a known manner to produce, 
illustratively, a 4:2:0 compressed output stream C YIQ . The first MPEG encoded 
output stream C YIQ is coupled to a first input of multiplexer 524. 

A graphical depiction illustrative the relative spatial frequency 

20 composition of the constituent signals of first MPEG encoded output stream C YIQ 
520G is provided to help illustrate the operation of the LL spatial filters 504 and 
506. 

Graphical depiction 520G shows three boxes of equal size. Each box 
illustrates the spatial frequency composition of an image component (i.e., Y, I or 

25 Q) by depicting the vertical frequencies of the image component as a function of 
the horizontal frequencies of the image component (i.e., f v v. f h ). The first box 
represents the spatial frequency composition of the full depth luminance signal 
Y, the second box represents the spatial frequency composition of the LL spatial 
filtered and subsampled in-phase chrominance signal I LL and the third box 

30 represents the spatial frequency composition of the LL spatial filtered and 
subsampled quadrature-phase chrominance signal Q, L . A box may be divided 
into four quadrants, a low horizontal frequency low vertical frequency (LL) 
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quadrant at the lower left, a low horizontal frequency high vertical frequency 
(LH) quadrant at the upper left, a high horizontal frequency low vertical 
frequency (HL) quadrant at the lower right and a high horizontal frequency high 
vertical frequency (HH) quadrant at the upper right. Information within a 
5 quadrant may be spectrally shifted to another quadrant in a known manner 
using frequency converters. 

It can be seen by inspection that the full depth luminance signal Y 
occupies the entire box (i.e., retains full spatial frequency composition). 
However, both the LL spatial filtered and subsampled in-phase chrominance 

10 signal I LL and quadrature-phase chrominance signal Q LL occupy only the lower 
left quadrant of their respective boxes (i.e., 1/2 the original spatial frequency 
composition in each of the vertical and horizontal directions). The shaded 
portions of the second and third boxes represent those portions of spatial 
frequency composition that have been removed by the operation of, respectively, 

15 the LL spatial filters 504 and 506. 

Spatial filters that divide images into the above-described frequency 
quadrants are well known in the art. For example, quadrature mirror filters 
(QMF) are suitable for performing this function. Thus, a skilled practitioner 
may implement LL spatial filters 504 and 506, LH spatial filter 508 and HL 

20 spatial filter 510 using QMF techniques. 

The LH spatial filter 508 operates in a known manner to horizontally low 
pass and vertically high pass filter the full depth quadrature-phase chrominance 
signal Q' to produce an LH spatial filtered and subsampled quadrature-phase 
chrominance signal Q LH , which is then coupled to the first frequency 

25 downconverter 509. The first frequency downconverter 509 operates in a known 
manner to shift the spectral energy of the LH spatial filtered and subsampled 
quadrature-phase chrominance signal Q I H from the LH quadrant to the LL 
quadrant. The resulting spectrally shifted quadrature-phase chrominance signal 
Q LH . is then coupled to a first chrominance input of the second MPEG encoder 

30 522. 

The HL spatial filter 510 operates in a known manner to horizontally high 
pass and vertically low pass filter the full depth quadrature-phase chrominance 

24 
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signal Q' to produce an LH spatial filtered and subsampled quadrature-phase 
chrominance signal Q HL , which is then coupled to the second frequency 
downconverter 511. The second frequency downconverter 511 operates in a 
known manner to shift the spectral energy of the HL spatial filtered and 
5 subsampled quadrature-phase chrominance signal Q HL from the HL quadrant to 
the LL quadrant. The resulting spectrally shifted quadrature-phase chrominance 
signal Q HL . is then coupled to a second chrominance input of the second MPEG 
encoder 522. 

Second MPEG encoder 522 operates in a known manner to produce, 

10 illustratively, a 4:2:0 compressed output stream C rQ . The second MPEG encoded 
output stream C rQ is coupled to a second input of multiplexer 524. 

Multiplexer 524 multiplexes the compression coded output streams from 
first MPEG encoder 520 (C YIQ ) and second MPEG encoder 522 (C IQ .) to form the 
compressed bit stream S21. 

15 A graphical depiction illustrative the relative spatial frequency 

composition of the constituent signals of second MPEG encoded output stream 
C rQ 522G is provided to help illustrate the operation of the LH spatial filter 508, 
HL spatial filter 510 and frequency downconverters 509 and 511. 

Graphical depiction 522G shows three boxes of equal size. The first box 

20 represents the spatial frequency composition of the full depth in-phase 
chrominance signal I', the second box represents the spatial frequency 
composition of the HL spatial filtered and subsampled, frequency 
downconverted, quadrature-phase chrominance signal Q HL> , and the third box 
represents the spatial frequency composition of the LH spatial filtered and 

25 subsampled, frequency downconverted, quadrature-phase chrominance signal 
Qlh» 

It can be seen by inspection that the full depth in-phase chrominance 
signal I' occupies the entire box (i.e., retains full spatial frequency composition). 
However, both the LH spatial filtered and subsampled, frequency 
30 downconverted, quadrature-phase chrominance signal Q LH . and the HL spatial 
filtered and subsampled, frequency downconverted, quadrature-phase 
chrominance signal Q HL . occupy only the lower left quadrant of their respective 
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boxes (i.e., 1/2 the original spatial frequency composition in each of the vertical 
and horizontal directions). The shaded portions of the second and third boxes 
(along with the lower left quadrants) represent those portions of spatial 
frequency composition that have been removed by the operation of, respectively, 
5 the HL spatial filter 5 lOand the LH spatial filter 508 . The Q LH , and Q HL . were 
spectrally shifted by, respectively, frequency downconverters 509 and 511 to the 
LL quadrant from the quadrants indicated by arrows. 

The multiplexed output stream S21 comprises a full depth luminance 
signal Y, a full depth in-phase chrominance signal I' and a partial resolution 

10 quadrature-phase chrominance signal (Q+Q LH ,+Q HL ). In effect, the multiplexed 
output stream S21 comprises a 4:4:3 coded YIQ representation of video 
information. However, it is known in the television arts to reconstruct an RGB 
(or YUV) format television signal using the YIQ format television signal 
comprising a full bandwidth luminance signal, full bandwidth in-phase 

15 chrominance signal and partial bandwidth quadrature-phase chrominance 
signal. Thus, as previously described, the video compression unit 21 
embodiment of FIG. 5A advantageously exploits the non-symmetrical bandwidth 
of chrominance components within a YIQ formatted television signal to achieve a 
further reduction in circuit complexity. 

20 FIGs. 5B and 5C depict respective high level block diagrams of an 

alternate embodiment of a video decompression unit according to the invention 
and suitable for use in an audio-visual information delivery system employing 
the video compression unit 21 of FIG. 5 A. 

FIG. 5B depicts a video decompression unit 43 comprising a demultiplexer 

25 530, an MPEG decoder 543 and a format converter 550. The demultiplexer 530 
receives a compressed bit stream S42 corresponding to the compressed bit 
stream S21 produced at the output of multiplexer 524. The demultiplexer 530 
extracts, and couples to the MPEG decoder 543, the compressed video stream 
corresponding to the output of the first MPEG encoder 520 of FIG. 5A (C YIQ ). 

30 The MPEG decoder 543 decodes the compressed stream C YIQ in a standard 

manner using, illustratively, 4:2:0 decompression to retrieve the full depth 
luminance signal Y, LL spatial filtered and subsampled in-phase chrominance 

26 
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signal 1^ and LL spatial filtered and subsampled quadrature-phase chrominance 
signal Q LL , each of which is coupled to the format converter 550. 

Format converter 550 operates in a standard manner to convert the Y1Q 
space video signal comprising full depth luminance signal Y, LL spatial filtered 
5 and subsampled in-phase chrominance signal I LL and LL spatial filtered and 

subsampled quadrature-phase chrominance signal Q LL to red R, green G and blue 
B RGB space output signals. 

FIG. 5C depicts a video decompression unit 43 comprising a demultiplexer 
530, first and second MPEG decoders 542 and 544, a pair of frequency 

10 upconverters 546 and 548, an adder 552 and a format converter 550. The 

demultiplexer 530 receives a compressed bit stream S42 corresponding to the 
compressed bit stream S21 produced at the output of multiplexer 524. The 
demultiplexer 530 extracts, and couples to the first MPEG decoder 542, the 
compressed video stream corresponding to the output of the first MPEG encoder 

15 520 of FIG. 5A (C YIQ ). The demultiplexer 530 extracts, and couples to the second 
MPEG decoder 544, the compressed video stream corresponding to the output of 
the second MPEG encoder 522 of FIG. 5A (C rQ ). 

The first MPEG decoder 542 decodes the compressed YIQ stream C YIQ in a 
standard manner using, illustratively, 4:2:0 decompression to retrieve the full 

20 depth luminance signal Y and the LL spatial filtered and subsampled 

quadrature-phase chrominance signal Q LL . It should be noted that while a 
standard MPEG decoder will also retrieve the LL spatial filtered and 
subsampled in-phase chrominance signal I LL , this signal is not used in the video 
decompression unit 43 of FIG. 5C. The full depth luminance signal Y is coupled 

25 to a luminance input of the format converter 550. The LL spatial filtered and 
subsampled quadrature-phase chrominance signal Q I L is coupled to a first input 
of the adder 552. 

The second MPEG decoder 544 decodes the compressed stream C rq in a 
standard manner using, illustratively, 4:2:0 decompression to retrieve the full 
30 depth in-phase chrominance signal F, the LH spatial filtered and subsampled, 
frequency downconverted, quadrature-phase chrominance signal Q LH , and the 
HL spatial filtered and subsampled, frequency downconverted, quadrature-phase 
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chrominance signal Q HL .. The full depth in-phase chrominance signal T is coupled 
to a first chrominance input of format converter 550. The LH spatial filtered and 
subsampled, frequency downconverted, quadrature-phase chrominance signal 
Q LH . is coupled to the first frequency upconverter 546. The HL spatial filtered 
5 and subsampled, frequency downconverted, quadrature-phase chrominance 
signal Q HL . is coupled to the second frequency upconverter 548. 

The frequency upconverter 546 operates in a known manner to upconvert 
the LH spatial filtered and subsampled, frequency downconverted, quadrature- 
phase chrominance signal Q LH . to produce LH spatial filtered and subsampled 

10 quadrature-phase chrominance signal Q LH . That is, the frequency upconverter 
546 shifts the spectral energy of the LH spatial filtered and subsampled, 
frequency downconverted, quadrature-phase chrominance signal Q I H , from the 
LL quadrant to the LH quadrant. The resulting upconverted signal Q LH is 
coupled to a second input of adder 552. 

15 The frequency upconverter 548 operates in a known manner to upconvert 

the HL spatial filtered and subsampled, frequency downconverted, quadrature- 
phase chrominance signal Q HL , to produce HL spatial filtered and subsampled 
quadrature-phase chrominance signal Q HL . That is, the frequency upconverter 
546 shifts the spectral energy of the HL spatial filtered and subsampled, 

20 frequency downconverted, quadrature-phase chrominance signal Q HL , from the 
LL quadrant to the HL quadrant. The resulting upconverted signal Q HL is 
coupled to a third input of adder 552. 

Adder 552 adds the LL spatial filtered and subsampled quadrature-phase 
chrominance signal Q LL , the LH spatial filtered and subsampled quadrature- 

25 phase chrominance signal Q LH and the HL spatial filtered and subsampled 
quadrature-phase chrominance signal Q HL to produce a near full-resolution 
quadrature-phase chrominance signal Q". The near full-resolution quadrature- 
phase chrominance signal Q" has a resolution of approximately three fourths the 
resolution of the full depth quadrature-phase chrominance signal Q\ The near 

30 full-resolution quadrature-phase chrominance signal Q" is coupled to a second 
chrominance input of format converter 550. 
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Format converter 550 operates in a standard manner to convert the YTQ 
space video signal comprising full depth luminance signal Y, the full depth in- 
phase chrominance signal F and the near full-resolution quadrature-phase 
chrominance signal Q" to red R, green G and blue B RGB space output signals. 
5 A graphical depiction 543G illustrative the relative spatial frequency 

composition of the constituent signals provided to the format converter 550 is 
provided to help illustrate the invention. 

Graphical depiction 543G shows three boxes of equal size. The first box 
represents the spatial frequency composition of the full depth luminance signal 

10 Y, the second box the spatial frequency composition of the full depth in-phase 
chrominance signal I' and the third box represents the spatial frequency 
composition of the near full-resolution quadrature-phase chrominance signal Q". 

It can be seen by inspection that the full depth luminance signal Y and the 
in-phase chrominance signal I' occupy the entirety of their respective boxes. By 

15 contrast, the near full-resolution quadrature-phase chrominance signal Q" 

occupies three fourths of its box. The shaded portion of the third box represent 
the portion of the full depth quadrature-phase chrominance signal Q' removed by 
the operation of the video compression unit 2 1 of FIG. 5 A. 

It must be noted that the near full-resolution quadrature-phase 

20 chrominance signal Q" only lacks information from HH quadrant (i.e., the high 
frequency horizontal and high frequency vertical quadrant). However, a loss of 
information from the HH quadrant is less discernible to the human eye than a 
loss of information from one of the other quadrants. Moreover, the full depth in- 
phase chrominance signal F may be used in a standard manner to provide some 

25 of this information. Thus, to the extent that the quadrature-phase chrominance 
signal Q" is compromised, the impact of that compromise is relatively low, and 
the compromise may be ameliorated somewhat using standard YIQ processing 
techniques. 

The invention has been described thus far as operating on, e.g., 4:4:4 
30 resolution MPEG video signals having a standard 8-bit dynamic range. The 8- 
bit dynamic range is used because standard (i.e., "off the shelf) components such 
as the MPEG encoders, decoders, multiplexers and other components described 
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above in the various figures tend to be adapted or mass produced in response to 
the need of the 8-bit television and video community. 

While an 8-bit dynamic range at 4:4:4 coding provides impressive picture 
quality, it may not be sufficient for the electronic cinema quality applications. 
5 Thus, the following portion of the disclosure will address modifications to the 
above figures suitable for implementing a high dynamic range system, 
illustratively a 10-bit dynamic range system. Specifically, an enhanced MPEG 
encoder and associated enhanced MPEG decoder will now be described. The 
enhanced encoder and decoder are based on the regional pixel depth compaction 

10 method and apparatus described in detail in co-pending U.S. Patent Application 
No. 09/050,304, filed on March 30, 1998, and Provisional U.S. Patent Application 
No. 60/071,294, filed on January 16, 1998, both of which are incorporated herein 
by reference in their entireties. 

Briefly, the described method and apparatus segments a relatively high 

15 dynamic range signal into a plurality of segments (e.g., macroblocks within a 
video signal); determines the maximum and minimum values of a parameter of 
interest (e.g., a luminance, chrominance or motion vector parameter) within each 
segment, remaps each value of a parameter of interest to, e.g., a lower dynamic 
range defined by the maximum and minimum values of the parameter of 

20 interest; encodes the remapped segments in a standard (e.g., lower dynamic 
range) manner; multiplexes the encoded remapped information segments and 
associated maximum and minimum parameter values to form a transport stream 
for subsequent transport to a receiving unit, where the process is reversed to 
retrieve the original, relatively high dynamic range signal. A technique for 

25 enhancing color depth on a regional basis can be used as part of the digitizing 
step to produce better picture quality in the images and is disclosed in the above- 
referenced Provisional U.S. patent application. 

FIG. 6A depicts an enhanced bandwidth MPEG encoder. Specifically, 
FIG. 6A depicts a standard MPEG encoder 620 and an associated regional map 

30 and scale unit 610 that together form an enhanced bandwidth MPEG encoder. 

The region map and scale unit 610 receives a relatively high dynamic 
range information signal Y 10 , illustratively a 10-bit dynamic range luminance 
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signal, from an information source such as a video source (not shown). The 
region map and scale unit 610 divides each picture-representative, frame- 
representative or field-representative portion of the relatively high dynamic 
range information signal Y 10 into a plurality of, respectively, sub-picture regions, 
5 sub-frame regions or sub-field regions. These sub-regions comprise, 

illustratively, fixed or variable coordinate regions based on picture, frame, field, 
slice macroblock, block and pixel location, related motion vector information and 
the like. In the case of a video information stream, an exemplary region 
comprises a macroblock region size. 

10 Each of the plurality of sub-regions are processed to identify, 

illustratively, a maximum luminance level (Y^) and a minimum luminance 
level (Y NUN ) utilized by pixels within the processed region. The luminance 
information within each region is then scaled (i.e., remapped) from, 
illustratively, the original 10-bit dynamic range (i.e., 0 to 1023) to an 8-bit 

15 dynamic range (i.e., 0-255) having upper and lower limits corresponding to the 
identified minimum luminance level (Y MIN ) and maximum luminance level (Y^) 
of the respective region to produce, at an output, an relatively low dynamic 
range, illustratively 8-bit, information signal Y 8 . The maximum and minimum 
values associated with each region, and information identifying the region, are 

20 coupled to an output as a map region ID signal. 

An encoder 610, illustratively an MPEG-like video encoder, receives the 
remapped, relatively low dynamic range information signal Y 8 from the region 
map and scale unit 610. The video encoder 15 encodes the relatively low 
dynamic range information signal Y 8 to produce a compressed video signal C Y8 , 

25 illustratively an MPEG-like video elementary stream. 

The above described enhanced MPEG encoder may be used to replace any 
of the standard MPEG encoders depicted in any of the previous figures. It 
should be noted that the exemplary enhanced MPEG encoder is shown as 
compressing a 10-bit luminance signal Y10 into an 8-bit luminance signal Y8 

30 that is coupled to a luminance input of a standard MPEG encoder. As previously 
discussed, the signal applied to the luminance input (Y) of an MPEG encoder is 
typically encoded at a full depth of 8-bits, while signals applied to the 
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chrominance inputs (U, V) of the MPEG encoder are typically encoded at less 
than full depth, such that the encoder nominally produces a 4:2:0 compressed 
signal. It must be noted that the region map and scale unit (or an additional 
unit) may be used to adapt a relatively high dynamic range signal (e.g., 10-bit) to 
5 the less than full depth range required for the MPEG encoder chrominance 
input. Such an adaptation is contemplated by the inventor to be within the 
scope of his invention. 

FIG. 6B depicts an enhanced bandwidth MPEG decoder that is suitable 
for use in a system employing the enhanced bandwidth MPEG encoder of FIG. 

10 6A. Specifically, FIG. 6B depicts a standard MPEG decoder 630 and an 
associated inverse regional map and scale unit 630 that together form an 
enhanced bandwidth MPEG decoder. 

The decoder 630, illustratively an MPEG-like video decoder, receives and 
decodes, in a known manner, the compressed video signal C Y8 to retrieve the 

15 relatively low dynamic range information signal Y 8 , which is then coupled to the 
inverse region map and scale unit 630. 

The inverse region map and scale unit 630 receives the relatively low 
dynamic range information signal Y 8 , illustratively an 8-bit luminance signal, 
and the associated map region ID signal. The inverse region map and scale unit 

20 630 remaps the 8-bit baseband video signal S13, on a region by region basis, to 
produce a 10-bit video signal S15 corresponding to the original 10-bit dynamic 
range video signal SI. The produced 10-bit video signal is coupled to a video 
processor (not shown) for further processing. The inverse region map and scale 
unit 60 retrieves, from the map region ID signal S14, the previously identified 

25 maximum luminance level (Y MAX ) and minimum luminance level (Y MIN ) associated 
with each picture, frame or field sub-region, and any identifying information 
necessary to associate the retrieved maximum and minimum values with a 
particular sub-region within relatively low dynamic range information signal Y 8 . 
The luminance information associated with each region is then scaled (i.e., 

30 remapped) from the 8-bit dynamic range bounded by the identified minimum 
luminance level (Y MIN ) and maximum luminance level (Y MAX ) associated with the 
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region to the original 10-bit (i.e., 0-1023) dynamic range to substantially 
reproduce the original 10-bit luminance signal Y 10 . 

Since the map region ID signal is necessary to restore the original 
dynamic range of the compressed video signal C Y8 , both of the signals are coupled 
5 to a decoder, such as the enhanced MPEG decoder of FIG. 6B. These signals 
may be coupled to the enhanced decoder directly or via a transport mechanism. 
For example, in the case of an enhanced encoder providing an encoded bitstream 
to a multiplexer (e.g., MPEG encoder 218R and multiplexer 219 of FIG. 2), the 
associated map region ID may be included as a distinct multiplexed stream or as 

10 part of a user stream. An enhanced decoder will retrieve both stream in a 
standard manner from a demultiplexer (e.g., MPEG decoder 432R and 
demultiplexer 431 of FIG. 2). 

It is crucial to note that any MPEG encoder depicted in any of the 
preceding figures may be replaced with the enhanced MPEG encoder depicted in 

15 FIG. 6A. Similarly, any MPEG decoder depicted in any of the preceding figures 
may be replaced with the enhanced MPEG decoder depicted in FIG. 6B. In the 
event that an enhanced decoder is used without a corresponding enhanced 
encoder, the inverse region map and scale unit 630 will not provide an 
enhancement function. However, the relatively low dynamic range signal 

20 applied to the inverse region map and scale unit 630 will not be further 
degraded. 

Thus, by judicious application of the enhanced MPEG encoder and 
enhanced MPEG decoder of, respectively, FIGs. 6A and 6B in the above 
embodiments of the invention, enhanced dynamic range for both luminance and 

25 chrominance components in an electronic cinema quality system may be 
realized. Moreover, the embodiments described may be implemented in an 
economical manner using primarily off-the-shelf components. 

Although various embodiments which incorporate the teachings of the 
present invention have been shown and described in detail herein, those skilled 

30 in the art can readily devise many other varied embodiments that still 
incorporate these teachings. 
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What is claimed is: 

1. In a system for distributing a video information signal (SI) comprising a 
plurality of full dynamic range components (R,G,B; Y,U,V; Y,I,Q), an apparatus 

5 comprising: 

a compression encoder (21), for compression encoding said video 
information signal in a manner substantially retaining the full dynamic range of 
said full dynamic range components, said compression encoder comprising at 
least two standard encoders (218; 215,217; 410,406,408,411,412,420; 520,522), 

10 each of said standard encoders being responsive to up to three component video 
signals, each of said standard compression encoders tending to substantially 
preserve a dynamic range and spatial resolution of at least one component of 
said video information signal, each of said standard compression encoders 
providing a compressed output video signal (S218); and 

15 a multiplexer (219; 216; 440; 524), for multiplexing said compressed 

output video signals of said two or more standard compression encoders to 
produce a multiplexed information stream (S21). 

2. The apparatus of claim 1, further comprising: 

20 an encryption encoder (22), for encrypting at least one of said compressed 

output video signals of said two or more standard compression encoders 
according to one of a watermarking process and an encryption process. 

3. The apparatus of claim 1, wherein said compression encoder further 
25 comprises: 

at least one regional map and scale unit (610) associated with each of said 
at least two standard encoders, for segmenting a component video signal into one 
or more information regions, and for remapping one or more relatively high 
dynamic range information parameters associated with each information region 
30 according to respective intra-region information parameter maxima and minima 
to produce a remapped component video signal (Y8) and an associated map 
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region identification stream (MAP REGION ID), said one or more remapped 
information parameters having a relatively low dynamic range; and 

a compression encoder (620), coupled to said regional map and scale unit, 
for compression encoding said remapped information stream to produce a 
5 compression encoded information stream. 

4. The apparatus of claim 1, wherein said compression encoder comprises: 
a first standard encoder (218R), for encoding a luminance component (Y) 

of said video signal in a manner substantially preserving a dynamic range and 
10 spatial resolution of said luminance component; 

a second standard encoder (218G), for encoding a first chrominance 
component (U) of said video signal in a manner substantially preserving a 
dynamic range and spatial resolution of said first chrominance component; and 
a third standard encoder (218B), for encoding a second chrominance 
15 component (V) of said video signal in a manner substantially preserving a 
dynamic range and spatial resolution of said second chrominance component. 

5. Apparatus for processing a video signal, said video signal comprising a 
luminance component (Y), a first color component (IP) and a second color 

20 component (V), said video signal components having respective full dynamic 

ranges, said apparatus comprising: 

a first encoder (410; 215), for encoding said video signal to produce a first 

encoded video signal (CYUV; S215), said first encoder encoding substantially the 

entire dynamic range of said luminance component (Y) of said video signal, a 
25 first portion (U; UL) of said dynamic range of said first color component of said 

video signal, and a first portion (V; VL) of said dynamic range of said second 

color component of said video signal; and 

a second encoder (406, 408, 411, 412, 420; 217), for encoding a second 

portion (dU; UH) of said dynamic range of said first color component of said 
30 video signal and a second portion (dV; VH) of said dynamic range of said second 

color component of said video signal. 
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6. The apparatus of claim 5, further comprising: 

a first filter complement (212), for filtering said first color component of 
said video signal to produce a low pass filtered first color component (UL) signal 
and a high pass filtered first color component signal (UH); and 
5 a second filter complement (213), for filtering said second color component 

of said video signal to produce a low pass filtered second color component signal 
(VL) and a high pass filtered second color component signal (VH); 

said low pass filtered first color component signal and said low pass 
filtered second color component signal being coupled to said first encoder as first 
10 dynamic range portions of, respectively, said first and second color components of 
said video signal; and 

said high pass filtered first color component signal and said high pass 
filtered second color component signal being coupled to said second encoder as 
second dynamic range portions of, respectively, said first and second color 
15 components of said video signal. 

7. The apparatus of claim 5, wherein said second encoder comprises: 

a decoder (420), for decoding said first (U) and second (V) color components 
of said first encoded video signal (CYUV) to produce, respectively, a first decoded 
20 color component signal (UD) and a second decoded color component signal (VD); 

a first subtracter (406), for subtracting said first decoded color component 
signal from said first color component of said video signal to produce a first color 
difference signal (dU); 

a second subtractor (408), for subtracting said second decoded color 
25 component signal from said second color component of said video signal to 
produce a second color difference signal (dV); 

a first standard encoder (411), receiving said first color difference signal at 
a nominally luminance input, for encoding said first color difference signal to 
produce an encoded first color difference signal (CdU); 
30 a second standard encoder (412), receiving said second color difference 

signal at a nominally luminance input, for encoding said second color difference 
signal to produce an encoded second color difference signal (CdV). 
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8. The apparatus of claim 5 wherein said first color component comprises an 
in-phase chrominance component (F), said second color component comprises a 
quadrature-phase chrominance component (Q'), and said first encoder further 

5 comprises: 

a first horizontal low pass/vertical low pass (LL) filter (504), for filtering 
said first color component of said video signal to produce an LL filtered first color 
component signal (ILL), said LL filtered first color component signal being 
coupled to said first encoder as a first dynamic range portion of said first color 

10 component of said video signal; and 

a second horizontal low pass/vertical low pass (LL) filter (506), for filtering 
said second color component of said video signal to produce an LL filtered second 
color component signal (QLL), said LL filtered second color component signal 
being coupled to said first encoder as a first dynamic range portion of said second 

15 color component of said video signal. 

9. A receiver, comprising: 

a demultiplexer (431), for extracting from an information stream (S42) a 
plurality of compressed component video information signals (R,G,B; Y,U,V; 
20 Y,I,Q); and 

a plurality of decoders (432; 310,320; 421-423), for decoding said 
compressed component video information signals to produce full range 
component video information signals; 

said compressed component video information signals comprising one of 

25 (a) a first signal comprising full dynamic range red video information , a second 
signal comprising full dynamic range green video information, and a third signal 
comprising full dynamic range blue; and (b) a first signal comprising full 
dynamic range luminance information, partial dynamic range first chrominance 
information and partial dynamic range second chrominance information, a 

30 second signal comprising a remaining dynamic range first chrominance 

information, and a third signal comprising a remaining dynamic range second 
chrominance information. 
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10. In a system for distributing a video information signal (SI) comprising a 
plurality of full dynamic range components (R,G,B; Y,U,V; Y,I,Q), a method 
comprising the steps of: 
5 compression encoding (21), using at least two standard encoders (218; 

215,217; 410,406,408,411,412,420; 520,522), each of said plurality of full 
dynamic range components of said video signal in a manner substantially 
preserving said full dynamic range of said components of said video signal, each 
of said standard encoders being responsive to up to three component video 

10 signals, each of said standard compression encoders tending to substantially 
preserve a dynamic range and spatial resolution of only one component of said 
video signal, each of said standard compression encoders providing a compressed 
output video signal; and 

multiplexing (219; 216; 440; 524) said compressed output video signals of 

15 said two or more standard compression encoders to produce a multiplexed 
information stream; 

each of said standard encoders being responsive to up to three component 
video signals, each of said standard compression encoders tending to 
substantially preserve a dynamic range and spatial resolution of only one 

20 component of said video signal. 
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